Human-computer Chinese Sign Language Interaction System
نویسنده
چکیده
The generation and recognition of body language is a key technologies of VR. Sign Language is a visual-gestural language mainly used by hearing-impaired people. In this paper, gesture and facial expression models are created using computer graphics and used to synthesize Chinese Sign Language (CSL), and from it a human-computer CSL interaction system is implemented. Using a system combining CSL synthesis and CSL recognition subsystem, hearing-impaired people with data-gloves can pantomime CSL, which can then be displayed on the computer screen in real time and translated into Chinese text. Hearing people can also use the system by entering Chinese text, which is translated into CSL and displayed on the computer screen. In this way hearing-impaired people and hearing people can communicate with each other conveniently.
منابع مشابه
MAN-MACHINE INTERACTION SYSTEM FOR SUBJECT INDEPENDENT SIGN LANGUAGE RECOGNITION USING FUZZY HIDDEN MARKOV MODEL
Sign language recognition has spawned more and more interest in human–computer interaction society. The major challenge that SLR recognition faces now is developing methods that will scale well with increasing vocabulary size with a limited set of training data for the signer independent application. The automatic SLR based on hidden Markov models (HMMs) is very sensitive to gesture's shape inf...
متن کاملDynamic Gesture Recognition using Transformation Invariant Hand Shape Recognition
In this thesis a detailed framework is presented for accurate real time gesture recognition. Our approach to develop a hand-shape classifier, trained using computer animation, along with its application in dynamic gesture recognition is described. The system developed operates in real time and provides accurate gesture recognition. It operates using a single low resolution camera and operates i...
متن کاملRecognizing and Interpreting Sign Language Gesture for Human Robot Interaction
Visual interpretation of sign language gesture can be useful in accomplishing natural human robot interaction. This paper describes a sign language gesture based recognition, interpreting and imitation learning system using Indian Sign Language for performing Human Robot Interaction in real time. It permits us to construct a convenient sign language gesture based communication with humanoid rob...
متن کاملPakistan Sign Language Recognition Using Statistical Template Matching
Sign language recognition has been a topic of research since the first data glove was developed. Many researchers have attempted to recognize sign language through various techniques. However none of them have ventured into the area of Pakistan Sign Language (PSL). The Boltay Haath project aims at recognizing PSL gestures using Statistical Template Matching. The primary input device is the Data...
متن کاملA Framework for a Sign Language Interfacing System
Sign languages have been proven to be natural languages, as capable of expressing human thoughts and emotions as traditional (spoken) languages are. The distinct visual and spatial nature of sign languages makes it difficult to develop an interfacing system as a communication medium platform for sign language users. This dissertation targets this problem by presenting some explorations in the a...
متن کامل